Balance resource allocation for spark jobs based on prediction of the optimal resource
نویسندگان
چکیده
منابع مشابه
An Algorithm for Resource Allocation through the Classification of DMUs
Data envelopment analysis (DEA) is a non-parametric method for assessing relative efficiency of decision-making units (DMUs). Every single decision-maker with the use of inputs produces outputs. These decision-making units will be defined by the production possibility set. Resource allocation to DMUs is one of the concerns of managers since managers can employ the results of this process to a...
متن کاملResource Allocation Strategies on Hybrid Cloud for Resilient Jobs
Cloud infrastructure o ers democratized access to on-demand computing resources for scaling applications beyond captive local servers. While on-demand, xed-price Virtual Machines (VMs) are popular, the availability of cheaper but less reliable spot VMs from cloud providers presents an opportunity to reduce the cost of hosting cloud applications. Our work addresses the issue of e ective and econ...
متن کاملOPTIMAL RESOURCE ALLOCATION IN DEA WITH INTEGER VARIABLES
Resource allocation and optimal leveling are among the top challenges in project management. This paper presents a DEA-based procedure for determining an optimal level of inputs to produce a fixed level of outputs. To achieve this goal, we assume that the levels of outputs can be forecasted in the next season and the procedure will determine optimal level of inputs for all DMUs. Such as some of...
متن کاملPrediction based resource allocation, a simulation experiment
We present an simulation experiment that can be used to asses the impact of using traffic prediction for online control on the performance of communication networks. A server with fixed output link bandwidth and impaired with high priority traffic is considered. The server shares its remaining available rate over K contending low-priority input streams queued at the input. An adaptive linear fi...
متن کاملCognitive resource manager framework for optimal resource allocation
Wireless networks are under constant pressure to provide ever higher data rates to increasing numbers of users with greater reliability. At the same time they are becoming more complex and challenging to manage. Great efforts are being done to make the wireless devices and networks adaptive and self-optimizing in order to more efficiently use the resources and deliver good quality services. Hig...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Tsinghua Science and Technology
سال: 2020
ISSN: 1007-0214
DOI: 10.26599/tst.2019.9010054